creative capability
LiveIdeaBench: Evaluating LLMs' Scientific Creativity and Idea Generation with Minimal Context
Ruan, Kai, Wang, Xuan, Hong, Jixiang, Wang, Peng, Liu, Yang, Sun, Hao
While Large Language Models (LLMs) have demonstrated remarkable capabilities in scientific tasks, existing evaluation frameworks primarily assess their performance using rich contextual inputs, overlooking their ability to generate novel ideas from minimal information. We introduce LiveIdeaBench, a comprehensive benchmark that evaluates LLMs' scientific creativity and divergent thinking capabilities using single-keyword prompts. Drawing from Guilford's creativity theory, our framework employs a dynamic panel of state-of-the-art LLMs to assess generated ideas across four key dimensions: originality, feasibility, fluency, and flexibility. Through extensive experimentation with 20 leading models across 1,180 keywords spanning 18 scientific domains, we reveal that scientific creative ability shows distinct patterns from general intelligence metrics. Notably, our results demonstrate that models like QwQ-32B-preview achieve comparable creative performance to top-tier models like o1-preview, despite significant gaps in their general intelligence scores. These findings highlight the importance of specialized evaluation frameworks for scientific creativity and suggest that the development of creative capabilities in LLMs may follow different trajectories than traditional problem-solving abilities.
- Asia > China > Beijing > Beijing (0.05)
- North America > United States > New York > New York County > New York City (0.04)
- Asia > China > Hong Kong (0.04)
- Research Report > New Finding (1.00)
- Research Report > Promising Solution (0.88)
- Education (0.68)
- Health & Medicine (0.46)
The future of AI is GPT-3
Written By: Manuel Chavez Sources: Located at the end of article. What is GTP-3 (Generative Pre-trained Transformer 3)? GTP-3 is a neural network machine learning model trained using data to generate any text. It requires a small amount of input text to generate large volumes of relevant machine generated text. The capabilities of GTP-3 include being able to generate various texts depending on the context. The model predicts statements according to the inputted text and because of its context based nature it can have creative capabilities.
919 Marketing Acquires Award-Winning Web Development and Digital Marketing Firm
RALEIGH, NC / ACCESSWIRE / August 8, 2022 / 919 Marketing, one of the nation's fastest-growing content marketing agencies, announces the acquisition of ClickCulture, a Raleigh, N.C. -based award-winning web development and digital marketing company. This is the third acquisition by 919 Marketing to boldly expand its roster of technology-focused marketing services to become the full-service marketing leader for emerging and mature franchise brands and non-profit companies. "This exciting new partnership with the team at ClickCulture expands our company to give us more creative firepower and a deeper bench of talent to better serve our clients", says David Chapman, CEO, and founder of 919 Marketing. "We can now elevate our creative capabilities to include custom applications for websites, unique digital campaigns, and elite, award-winning graphic design to help our clients attract more customers and grow their businesses. We have a lot of smart people doing great work and now we have the data-driven creative capabilities needed to truly dominate as the holistic, one-stop solution for nonprofit companies and multi-location and franchise brands."
Creativity of Deep Learning: Conceptualization and Assessment
Schneider, Johannes, Basalla, Marcus
While the potential of deep learning(DL) for automating simple tasks is already well explored, recent research started investigating the use of deep learning for creative design, both for complete artifact creation and supporting humans in the creation process. In this paper, we use insights from computational creativity to conceptualize and assess current applications of generative deep learning in creative domains identified in a literature review. We highlight parallels between current systems and different models of human creativity as well as their shortcomings. While deep learning yields results of high value, such as high quality images, their novelity is typically limited due to multiple reasons such a being tied to a conceptual space defined by training data and humans. Current DL methods also do not allow for changes in the internal problem representation and they lack the capability to identify connections across highly different domains, both of which are seen as major drivers of human creativity.
- North America > United States > New York > New York County > New York City (0.04)
- Europe > Liechtenstein > Vaduz > Vaduz (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- (4 more...)
- Overview (0.89)
- Research Report > Promising Solution (0.69)